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SUB-PIPELINED AND PIPELINED EXECUTION IN A VLIW 



10 



Field of the Invention 

This invention relates in general to instruction set architectures and more 
specifically to sub-pipelined and pipelined instruction execution in a VLIW. 



Background of the Invention 

Traditionally, Very Long Instruction Word, VLIW processors have been defined 
by the following set of attributes. The ability to specify multiple, independent operations 
in each instruction, (a MultiOp instruction.) VLIW architectures are horizontal machines, 
15 with each wide instruction-word or MultiOp, consisting of several operations or , Ops. 
_ All Ops in a MultiOp are issued in the same execution schedule. Programs that 
ci assume specific non-unit latencies for the operations and wliich, in fact, are only correct 
□ when those assumptions are true. The requirement for static, compile-time operation 
"ff, scheduling taking into account operation latencies and resource availability. 
fSo Consequently, the requirement that the hardware conform exactly to the assumptions 
s built into the program with regards to the number of functional units and the operation 
latencies. The absence of any interlock hardware, despite the fact that multiple, 
pipelined operations are being issued every cycle. 
O The original attraction of this style of architecture is its ability to exploit large 

Is amounts of instruction-level parallelism (ILP) with relatively simple and inexpensive 
control hardware. Whereas a number of VLIW products have been built which are 
capable of issuing six or more operations per cycle [4, 5, 3], it has just not proven 
feasible to build superscalar products with this level of ILP [18, 2, 14, 8, 7, 6]. 
Furthermore, the complete exposure to the compiler of the available hardware 
30 resources and the exact operation latencies permits highly optimized) schedules. 

These ver/ same properties have also led to the perception that VLIW 
processors are of limited interest as products. The rigid assumptions built into the 
program about the hardware are viewed as precluding object code compatibility 
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5 between processors built at different times witii different teclinologies and, tiierefore, 
having different latencies. Even in tiie context of a single processor, the need for the 
compiler to schedule to a latency, that is fixed at compile-time, is problematic with 
operations such as loads which can have high variability in their latency depending on 
whether a cache hit or miss occurs. Because of this latter problem, VLIW products 
10 have rarely adhered to the ideal of no interlock hardware, whatsoever. Alternatively, 
with an implementation of a VLIW architecture, interlocking and stalling of the processor 
is common when a load takes longer than expected. 

The conventional wisdom is that dynamic scheduling is inapplicable to VLIW 
processors. A first step towards understanding how to perform dynamic scheduling on 
15 VLIW processors is to recognize the distinction between traditional VLIW processors 
and the concept of a VLIW architecture. A VLIW processor is defined by a specific set 
Ci of resources (functional units, buses, etc.) and specific execution latencies with which 
p the various operations are executed. If a program for a VLIW processor is compiled 
and scheduled assuming precisely those resources and latencies, it can be executed 
Mo on that processor in an instmction-level parallel fashion without any special control 
r logic. Conversely, a VLIW processor that has no special control logic can only correctly 
m execute those programs that are compiled with the correct resource and latency 
2f assumptions. VLIW processors have traditionally been built with no special control 
O logic and this has led to the conclusion that VLIW processors must necessarily be 
"25 designed in this fashion. 

A different view of VLIW is as an architecture, i.e., a contractual interface between 
the class of programs that are written for the architecture and the set of processor 
Implementations of that architecture. The usual view is that this contract is concerned 
with the instruction format and the interpretation of the bits that constitute an Instruction. 
30 But the contract goes further and it is these aspects of the contract that are of primary 
importance in this patent. First, via its MultiOp capability, a VLIW architecture specifies 
a set of operations that are guaranteed to be mutually independent (and which. 
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5 therefore, may be issued simultaneously without any checks being made by the issue 
hardware). 

Second, via assertions about the operation latencies, an architecture specifies how 
a program is to be interpreted if one is to correctly understand the dependencies 
between operations. In the case of a sequential architecture, most latencies are 
10 assumed by the programmer to be a single cycle. So, the input operands for an 
operation must appear to that programmer to be determined by all the operations that 
were issued (and, in most cases, completed) before the operation in question. This is 
true because there are some sequential architectures, SPARC for example, where 
some instructions (branches with delay slots) have non-unit latencies. 
15 In the case of programs for VLIW architectures, with operations having non-unit 
^ latencies, the input operands for an operation are not determined by all the operations 
O that were issued before the operation in question. What matters is the operations that 
?i are supposed to have completed before the issuance of the operation in question, 
y Operations that were issued earlier, but which are not supposed to have completed as 
r^o yet, do not impose a flow dependence upon the operation in question. 
^' A program has unit assumed latencies (UAL) if the semantics of the program are 

y correctly understood by assuming that all operations in one instruction complete before 
W the next instruction is issued. A program has non-unit assumed latencies (NUAL) if at 
Q least one operation has a non-unit assumed latency, L, which is greater than one, i.e., 
^5 the semantics of the program are correctly understood if exactly the next L-1 

instructions are understood to have been issued before this operation completes. An 
architecture is UAL (NUAL) if the class of programs that it is supposed to execute are 
UAL (NUAL). We shall use the terms NUAL program and latency-cognizant program 
interchangeably. 

30 Very Long Instruction Word, VLIW, processors are viewed as an attractive way 

of achieving instruction-level parallelism because of their ability to issue multiple 
operations per cycle with relatively simple control logic. Although VLIW architectures 
offer the advantages of simplicity of design and high issue rates, a major impediment to 
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5 the use of VLIW and other novel ILP architectures is that they are not compatible with 
the existing software base. Lack of object code compatibility in VLIW architectures 
across processors having different hardware latencies and varying levels of parallelism 
is a severe limit to their adoption as a general purpose computing paradigm. This 
means that an installed software base of binaries cannot be built around a family of 
10 generations. The economic implications of this problem are enormous, and an efficient 
solution is necessary if VLIW architectures are to succeed. Two classes of approaches 
to this problem have been reported in the literature: hardware approaches and software 
approaches. Although these techniques may provide compatibility, they do so at the 
expense of hardware complexity that can potentially impact cycle time. A typical 
15 software approach is to statically recompile the VLIW program from the object file. The 
approach generates multiple executables, which poses difficulties for commercial copy 
iO protection and system administration. For example, if a first generation of a machine 
has certain latencies involved with each functional unit and the second generation 
VLIW machine has different latencies involved with those same functional units, the old 
Jo VLIW schedule cannot be guaranteed to execute properly on the second generation 
r machine due to the flow dependence between the different operations. The same type 
^ of problem results if the second generation machine includes an additional functional 
2 unit Even if the latencies remained the same, the code scheduled for this new 
O machine would not execute correctly on the older machines because the scheduler has 
""25 moved operations in order to take advantage of the additional multiplier. There is no 
trivial way to adapt this schedule to the older machines. This is the case of downward 
incompatibility between generations. In this situation, if different generations of the 
machines share binaries, compatibility requires either a mechanism to adjust the 
schedule or a different set of binaries for each generation. IBM describes hardware 
30 features for an ILF^ machine called DAISY (Dynamically Architected Instruction Set from 
Yorktown). DAISY is specifically intended to emulate existing architectures, so that all 
existing software for an old architecture (including operating system kernel code) runs 
without changes on the VLIW architecture. Each time a new fragment of code is 
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5 executed for the first time, the code is translated to VLIW primitives, parallelized and 
saved in a portion of main memory not visible to the old architecture, by a Virtual 
Machine Monitor (software) residing in read only memory. Subsequent executions of 
the same fragment do not require a translation (unless cast out). A limitation of the 
hardware approaches is that the scope for scheduling is limited to the window of Ops 
10 seen at run-time, hence available I LP is relatively less than what can be exploited by a 
compiler. These schemes may also result in cycle time stretch, a phenomenon due to 
which many are considering the VLIW paradigm over superscalar for future generation 
machines. 

Instruction set architecture is a description of a computer architecture at the level 
15 the programmer can observe. A programmer's model of a computer architecture is a 
_ similar term. In an exposed-pipeline architecture, the delays associated with pipelined 
ID execution of instructions are visible in the instruction set architecture and can be 
p exploited to improve computational bandwidth, 

1=! Other techniques of solving the compatibility issues involve migrating the 

rao software across to a new machine architecture. In these applications, oftentimes the 
r original old architecture that is trying to be emulated, or the native instruction set 
^ architecture of a processor, is called the base architecture. The VLIW which emulates 
M the old architecture, or any instruction set architecture, other than the base architecture 
O of a given processor that will be supported on that processor, is called the migrant 
'"25 architecture. 

Code compatibility between current and future generations of exposed pipeline 
VLIW DSPs is the example of compatibility reflected by this invention. For example, the 
Tl C6000 DSP and the Tl 64 bit C6000 DSP extension are the current and future 
architectures. The Tl 64-bit C6000 DSP architecture contains changes in ISA visible 
30 pipelining and other architectural features to provide higher operating frequencies. 
These changes are reconciled with requirements for binary compatibility and a robust 
code migration path implemented with the invention below. 
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5 Summary of the invention 

A subpipeliined translation embodiment providing binary compatibility between 
current and future generations of DSPs is disclosed. When a fetch packet is retrieved 
from memory, the entire fetch packet is assigned an operating mode (base instruction 
set or migrant instruction set) according to the execution mode at the time the request 

10 was made to the instruction memory for the fetch packet. The fetch packets from the 
instruction memory are parsed into execute packets and sorted by execution unit 
(dispatched) in a datapath shared by both execution modes(base and migrant). 
Because the fetch packet syntax and execution unit encoding is different between the 
migrant and base architecture in this case, the two execution modes have separate 

15 control logic. Instructions from the dispatch datapath are decoded by either base 
architecture decode logic or the migrant architecture decode logic, depending on the 

0 execution mode bound to the parent fetch packet of the instructions being decoded. 

□ Code processed by the migrant and base decode pipelines produces machine words 
fj that control the register files and the execution hardware functional units. These 

Jo machine words are selected with a multiplexer. The choice of the eventual machine 

word from the multiplexer is governed by the operating mode bound to the fetch packet 
^ that produced the machine word and sequencing logic for sub-pipelined execution. The 
J selected machine word controls a global register file, which supplies operands to all 

□ hardware execution units and accepts results of all hardware execution units. 

l5 

Brief Description of the Drawings 

Figure 1 illustrates an example of migrant code of a subpipelined execution 
migrant architecture which has 1/4 the instruction latency the of the base architecture. 

Figure 2 illustrates the rescheduling of the migrant code, running in subpipelined 
30 execution mode, after translation to the base architecture code, illustrating the 
inefficiency of the translation. 

Figure 3 illustrates a sub-pipelined translation embodiment according to a 
preferred embodiment of the invention. 
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5 

Detailed Description of the Preferred Embodiments 

Subpipelined execution is a hardware-efficient method for executing code from a 
migrant exposed-pipeline architecture. In this method, the base architecture is 
designed with a fixed multiple(call this S) of the instruction latencies of the desired 

10 migrant architecture. With this relationship between the migrant and base 
architectures, code from the migrant architecture can be executed on the base 
architecture by delaying the issue of migrant instructions by 8-1 clock cycles. In 
addition to providing the subpipelined execution mode, facilities are provided to change 
between base and migrant instruction sets with low overhead. 

15 Given the code illustrated in Figure 1 , and a base architecture with 4 times the 

instruction latency of the migrant architecture for all instructions, as illustrated in the 



table below: 



Instruction 


Migrant Delay 


Migrant 


Base Delay 


Base Latency 




Slots 


Latency 


Slots 




ADD 


0 


1 


3 


4 


AND 


0 


1 


3 


4 


OR 


0 


1 


3 


4 


MUL 


1 


2 


7 


8 



Table 1. Comparison between migrant and base architecture latencies 



20 The code can be rescheduled in the base architecture as illustrated in Figure 2. 

As is illustrated, because of all the NOPs necessary to make up difference in latencies 
between the base and migrant codes, the code running in subpipelined execution mode 
will not exceed a fraction of the performance of the base architecture instruction set. 
Depending on the performance requirements and other characteristics of the code, two 

25 automated approaches are available to enhance the performance of code from the 
migrant architecture. First code from the migrant architecture can be re-linked with 
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5 libraries written in the base arclnitecture, and second, off-line binary translation 
techniques can convert migrant architecture code to base architecture code. 

In the case of migrant code with base libraries, the performance gain over the 
subpipelined case is proportional to the execution time spent in the base libraries and 
the performance of the library routines in the base ISA. The time spent In libraries 
10 varies strongly with applications, but it is not uncommon for greater than 50% of the 
execution time of an application to be in libraries in the 32-bit C6000 DSP instruction 
set. 

Off-line binary translation takes in binary code from the migrant architecture, 
reverse-assembles the code and converts it to the base architecture. The conversion 
15 process can be implemented In several ways.. Conversion is simplified by having the 

sub-pipelined execution mode: cases that can be recognized as difficult or non- 
B translatable execute in sub-pipelined mode. This allows off-line translation to be 
Q deployed incrementally: as the notion of difficult varies over time, the fraction of the 
S code executing in subpipelined mode varies. 

5|o Although the previously discussed(ln the Background of Invention) IBM and HP 

= and North Carolina State University solutions on supporting compatibility between 
m generations of VLIW processors may result in VLIW base architectures that can support 
jj; migrant architectures, these solutions are not appropriate solutions for DSPs. In 
O particular, dynamic translation approaches as described by the IBM and NCSU works 
Is fail to provide the run-time predictability required for real-time DSP applications. The 
method described in the HP work will have complex but deterministic run-time, but 
substantial hardware costs from the delayed -issue instruction buffer, delay register file 
and copyback unit. 

Work has also been published involving CISC to superscalar RISC translation. 
30 Later versions of this same work involves static translation coupled with software 

simulation of the migrant architecture running on the base architecture. In the present 
invention, all of the functions of the software simulation of the migrant architecture are 
replaced with hardware execution in subpipelined mode. 
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5 Figure 3 illustrates a subpipelined translation embodiment according to a 

preferred embodiment of the invention. In this invention, code is fetched from memory. 
The instruction memory may be implemented as a directly-addressed RAM or cache. 
The code in the instruction memory can appear to the programmer to be in the migrant 
instruction set or in the base instruction set. In an implementation, the code in the 
10 instruction memory may be pre-decoded to facilitate later instruction processing. A 
group of instructions simultaneously retrieved from memory is called a fetch packet. 
Fetch packets are assigned an operating mode (base instruction set or migrant 
instruction set) according to the execution mode at the time the request was made to 
the instruction memory for the fetch packet. This allows for rapid mode transitions. 
15 The fetch packets from the instruction memory are parsed into execute packets 

and sorted by execution unit (dispatched) in a datapath shared by both execution 
a modes(base and migrant). Because the fetch packet syntax and execution unit 
□ encoding is different between the migrant and base architecture in this case, the two 
^ execution modes have separate control logic, 

m Instructions from the dispatch datapath are decoded by either base architecture 

E decode logic or the migrant architecture decode logic, depending on the execution 
S mode bound to the parent fetch packet of the instructions being decoded. In the case 
2 of exposed-pipeline VLIW instruction sets, the decode logic for the base and migrant 
O architectures primarily translates opcodes to the control signals required to execute the 
"25 specified instructions on the execution hardware functional units. Because of the 
relationship defined in this invention with regard to the latencies of the migrant and 
base instruction sets(the base operations have twice the latency of the migrant 
operations) and the exposed pipeline characteristics of these instruction sets, 
instruction decoding techniques that need knowledge of the pipeline depth, instruction 
30 graduation and instruction dependencies are not required. This results in reduced 
hardware and complexity in the instruction decode logic. 

Code processed by the migrant and base decode pipelines produces machine 
words that control the register files and the execution hardware functional units. These 
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machine words are selected with a multiplexer, which can also select a third No- 
operation instruction choice. The choice of the eventual machine word from the three 
possibilities is governed by the operating mode bound to the fetch packet that produced 
the machine word and sequencing logic for sub-pipelined execution. 

In the first preferred embodiment of this invention, the selected machine word 
controls a global register file, which supplies operands to all hardware execution units 
and accepts results of all hardware execution units. Two hardware pipeline clock 
cycles later, the selected machine word controls local register files that supply operands 
to either local execution hardware functional units or neighbor hardware execution 
functional units. F inally, the selected machine word controls the various types of 
execution hardware that evaluate functions on the operands to produce the results. 



TI-29338-10- 



5 Claims 
I claim: 

1. The structure of a subpipelined translation embodiment providing binary 
compatibility between a base architecture and migrant architecture of a VLIW 
architecture comprising: 

10 a VLIW architecture comprising a base architecture and a migrant architecture 

and having a base execution mode and a migrant execution mode; 

a fetch packet retrieved from memory, the fetch packet having an operating 
mode in dependence upon the execution mode at the time the request was made to the 
memory for the fetch packet; 
15 a shared datapath by both the base and migrant architectures for parsing said 

base architecture mode and migrant architecture mode fetch packets into execute 
=5 packets and for dispatching those base execute packets to the appropriate base 
Q architecture decode of the execute hardware; 

W a migrant architecture control circuit for dispatching execute packet instructions 

rUo having a migrant e^xecution mode to a migrant architecture decode; 

" execute hardware for executing execute packet instructions on execution units 

y and having a base architecture decode and a migrant architecture decode for decoding 

K said base architecture instructions and said migrant architecture instructions, 

□ respectively, in dependence upon the execution mode of the fetch packet of the 

'2^5 instructions being decoded, prior to executing; 

a multiplexer having at least two inputs and one machine word output wherein 
one input is the output of said migrant architecture decode and the other input is the 
output of said base architecture decode, said multiplexer choosing in dependence upon 
the operating mode of said fetch packet; 
30 machine words for controlling the execution hardware units. 

2, The structure according to Claim 1 , and further comprising a third input to 
said multiplexer wherein said third input is a no operation instruction 
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5 

3. The structure according to Claim 1 , wherein said machine word also controls 
registers. 

4. The structure according to Claim 1, wherein said machine word controls a 

10 global register file,, which supplies operands to all hardware execution units and accepts 
results of all hardware execution units. 

5. The structure according to Claim 4, wherein said machine word controls local 
register files that supply operands to either local execution hardware functional units or 

15 neighbor hardware execution functional units subsequent to said machine word 
controlling said global register file. 

D 6. The structure according Claim 5, wherein said machine word controls the 

SI various types of execution hardware that evaluate functions on the operands to produce 
^o the results of said hardware execution units subsequent to said machine word 

i u s 

E controlling said local register files. 

; S 

1^ 7, The structure according to Claim 1 , wherein the base and migrant architecture 

O decode units translates opcodes to the control signals required to execute the specified 

^5 instructions on the execution hardware functional units. 

8. The structure according to claim 1 , and further comprising said migrant 
architecture control circuit for issuing no-operation instruction to preserve the semantics 
of the instruction in the migrant architecture. 

30 

9. The structure according to Claim 1 , wherein said VLIW architecture is a 
Digital signal Processor (DSP). 
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5 

10. A method of providing binary compatibility between a base architecture and 
migrant architecture of a VLIW architecture comprising the steps of: 

executing a base execution mode and a migrant execution mode on a base 
10 architecture and a migrant architecture, respectively, on a VLIW architecture; 

providing a fetch packet retrieved from a memory, the fetch packet having an 
operating mode in dependence upon the execution mode at the time the request was 
made to the memory for the fetch packet; 

parsing said base architecture mode and migrant architecture mode fetch 
15 packets into execute packets and dispatching those base execute packets to the 

appropriate base architecture decode of the execute hardware on a shared datapath by 
^ both the base and migrant architectures; 

p dispatching execute packet instructions having a migrant execution mode to a 

2; migrant architecture decode on a migrant architecture control circuit; 
fUo executing execute packet instructions on execution units of execute hardware 

r said execute hardware having a base architecture decode and a migrant architecture 

decode for decoding said base architecture instructions and said migrant architecture 
W instructions, respectively, in dependence upon the execution mode of the fetch packet 
O of the instructions being decoded, prior to executing; 

choosing, in dependence upon the operating mode of said fetch packet, between 

the output of said migrant architecture decode and the output of said base architecture 

decode in a multiplexer having one machine word output; 

controlling the execution hardware units with said machine word. 

30 11. The method according to Claim 1 0, and further comprising choosing 

between the output of said migrant architecture decode and the output of said base 
architecture decode input and a no operation instruction 
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12. The method according to Claim 10, and further comprising controlling 
registers with said machine word. 

13. The method according to Claim 10, and further comprising controlling a 
global register file with said machine word, which supplies operands to all hardware 
execution units and accepts results of all hardware execution units. 

14. The structure according to Claim 13, and further comprising controlling local 
register files that supply operands to either local execution hardware functional units or 
neighbor hardware execution functional units subsequent to said controlling said global 
register file. 

15. The method according Claim 14, and further comprising controlling the 
various types of execution hardware that evaluate functions on the operands to produce 
the results of said hardware execution units subsequent to controlling said local register 
files. 

16. The method according to Claim 10, and further comprising translating 
opcodes to the control signals required to execute the specified instructions on the 
execution hardware functional units within the base and migrant architecture decode 
units. 

17. The method according to claim 10, wherein said VLIW architecture Is a 
Digital Signal Processor (DSP). 

18. The method according to Claim 10 and further comprising the step of issuing 
no-operation instruction from said migrant architecture control circuit, to preserve the 
semantics of the instructions in the migrant architecture. 
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Abstract 

A subpipelined translation embodiment providing binary compatibility between 
current and future generations of DSPs is disclosed. When a fetch packet is retrieved 
from memory, the entire fetch packet is assigned an operating mode (base instruction 
set or migrant instruction set) according to the execution mode at the time the request 
was made to the instruction memory for the fetch packet. The fetch packets from the 
instruction memory are parsed into execute packets and sorted by execution unit 
(dispatched) in a datapath shared by both execution modes(base and migrant). 
Because the fetch packet syntax and execution unit encoding is different between the 
migrant and base architecture in this case, the two execution modes have separate 
control logic. Instructions from the dispatch datapath are decoded by either base 
architecture decode logic or the migrant architecture decode logic, depending on the 
execution mode bound to the parent fetch packet of the instructions being decoded. 
Code processed by the migrant and base decode pipelines produces machine words 

that control the register files and the execution hardware functional units. These 
machine words are selected with a multiplexer. The choice of the eventual machine 
word from the multiplexer is governed by the operating mode bound to the fetch packet 
that produced the machine word and sequencing logic for sub-pipelined execution. The 
selected machine word controls a global register file, which supplies operands to all 
hardware execution units and accepts results of all hardware execution units. 
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